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Abstract 



Hi«rarchicaUy organized knowledge about actions haa been postulated 
*^ eiqplain planning in problem solving. Perdix, a simulation of prob- 
lem solving in geometry with schematic planning knowledge, is described, 
Perdljc' planning knowledge enables it to augment the problem space it 
i8 given by constructing auatdliary lines. The planning system also 
provides a mechanism that can result in problem- solving set. Resiilts 
of three experiments involving set and constructions seem consistent 
with the kinds of knowledge structures hypothesized in the model. Pro- 
tocols given during solution of 11 geometry problems showed general 
agreement with the e3q>lanation of constructions and set based on planning 
knowledge, but also indicated processes of human problem solving not 
represented in the model," Finally, the explanation of constructions is 
discussed in relation to the general question of ill- structured problems 
and creativity, and the explanation of set is discussed in relation to 
other phenomena in the problem -solving literature, including fimctional 
fixedness. 
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THEORY OF CONSTRUCTIONS AND SET IN PROBLEM SOLVING 
Jazxxes G. Greeno and Maria E, Magone 
University of Pittsburgh 

Seth Chaiklin 
University o£ Washington 



Several recent aknalyses of knowledge used in solving problems 
have hypothesized a structure in which knowledge about actions is 
hierarchical. Knowledge about each action includes knowledge about 
preconditions that are reqxiired for the action to be performed^ knowl- 
edge about conseqpiences of the action, and knowledge of the coznponent 
subactions that are performed in the process of performing the more 
global action* A system based on this principle was developed by 
Sacerdoti (1977) in the domain of robotics, and systems designed along 
si mil ar lines have been proposed for a number of other problem do- 
mAins* These include an analysis of geometry theorem proving by 
Goldstein (Note 1), analyses of solving textbook problems in physics 
by Bhaskar and Simon (1977) and by Larkin (Note 2), an analysis of 
designing electrical circuits by Sussman (1977), an analysis of writing 
prose by Flower and Hayes (in press), an analysis of designing com- 
puter programs by.Atwood, Poison, Jeffries, and Ramsey (Note 3), 
by Goldstein and Miller (Note 4), and by Long (Note 5), and a general 
discussion by McDermott (1978). These theories are all consistent 
in a general way with earlier suggestions by Berlyne (1965), Duncker 
(1945), Hull (1930), MiUer, Galanter, and Pribram (I960), and others 
regarding hierarchical structure of thinking and behavior. The more 
recent work has included hypotheses about the specific knowledge 
structures involved in performing the various kinds of tasks that 
have been studied. 
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This paper presents an analysis of hierarchical knowledge for 
planning in solving textbook problems in high school geometry. A 
sizuulation model of problem solving called Perdix (Greeno, 1978) has 
been extended in a way that involves hierarchical planning knowledge. 
This development has provided two extensions of previous theories. 
First, an eaqjlanation is provided for the occurrence of constructions 
in problem solving. Second, the knowledge of global actions used in 
planning provides an e3q>lanation of problem- solving set. 

The developments presented here permit a conceptual integration 
of several general issues in the theory of problem solving. The process 
developed for constructions is relevant to issues in the theory of ill- 
structured problem solving and the theory of creativity. There is a 
strong connection between constructions aind set, because the main 
cognitive structure that causes set is also the struct\ire ti^ at permits 
constructions to occur. 

One feature of ill- structured problems is that important nnaterials 
needed for solution are not provided in the Initial problem space. Aux- 
iliary lines needed for solving some geometry problems are materials 
that must be added to the problem space by the problem solved. Thus, 
Perdix* ability to add cont tructions provides some new understanding 
of an aspect of iU-structured problem solving. In the domain of ge- 
ometry, the problem- solving demands are relatively modest in com- 
parison, for example, with musical composition (Reitman, 1965). 
Nonetheless, the kind of process that /snables Perdix to construct 
auxiliary lines seems applicable in other domains as well. 

The process represented in Perdix for augmenting a problir 3i 
space involves a form of problem finding. Problem finding has been 
ir'.entlfied as a major factor in creative work on ill- structured prob- 
lems such as painting {Getzels k Csiksxentmihalyi, 1976). Thus, the 
theoretical development to be presented may provide a step toward a 
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more rigorous analyeis of aome aspects of creative processes in 
problem, solving* 

The explar ition of set that is provided by hierarchical knowledge 
of actions is entirely consistent with conventional explanations of set 
in experimental psychology (e»g, ^ Bourne, Ekstrand & Donxinowski^ 
1971)* The representation in Perdix specifies knowledge structures 
for solving a class of problems in a way that shows how set can occur. 
The point of greatest interest is the close relationship between the 
cognitive structures involved in set and constructions* The analysis 
also suggests some ways to begin to interpret the considerable exper*^ 
Imental literature on problem- solving set in relation to recently 
developed theoretical concepts of information processing and repre- 
sentation of knowledge. 

We will begir:i by presenting illustrations of the phenomena of 
constructions a ad set in geometry problem solving in order to provide 
a concrete context for the theoretical concepts that we will develops 
Next« we will de<.^Qribe the knowledge used by Perdix for planning* and 
the way in which Perdiic simulates phenomena of constructions and set. 
Then we will describe the resxilts of three experiments and a set of 
thtnking^aloud protocols that provide further illustrations of the prir.- 
ciples that are incorporated in the model and also indicate some 
important aspects of human processing involving constructions tliat 
are beyond the capabilities programmed in Perdix. Finally* we will 
discuss general implications of the analysis concerning the relation 
of constructions to the issues of ill-structured problems and creativity 
&nd the general question of let in problem solving. 

Example of Construction 

An example of a problem that is solved with a simple construction 
is the following: Prove that if two sides of a triangle are congruent^ 
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then the angles opposite those sides are congruent. (An alternative 
statement is: Throve that the base angles of an isosceles triangle are 
congruent. ) 

Table 1 shows a protocol of a solution of this problem- The 
student began by drawing a triangle, labelling its vertices A, ^ -jd 
C, marking the congruent sides AC and BC, and marking the angles 
at A and B, which were to T:)e proved congruent, as shown in Figure 1. 
At *1 in the protocol the student drew a line from C to the base of the 
triangle, labelling the point of intersection D. At "^Z the student ten- 
tatively specified that CD would be the bisector of ^CB, and confirmed 
this at *3 when it was realized that since CD Is in both triangles, it 
provides the needed second pair of congruent sides for the side-angle- 
side pattern of congruence of triangles. 

Example of Set 

Consider the problem shown i*i Figure 2. The problem can be 
solved by proving that triangles are congruent: A.ACM ^ ABDM 
(side-side -aide); then ^AMC ^" ^MD since they are corresponding 
parts of congruent triangles. However, an easier solution is possible. 
^MC and /BMP are vertical angles, so their congruence can be 
inferred directly. 

Luchins (1942) gave a problem like the one in Figure 2 to 10 stu- 
dent subjects who had just solved a series of four problems in which 
congruence of angles was shown by proving that triangles were con- 
gruent. Eight of these 10 students solved the problem by proving that 
triangles were congruent, rather than the simpler solution involving 
vertical angles. Another set of 10 students solved four problems 
involving congruence of triangles, followed by a problem similar to 
Figure 1 in which the given information was insufficient to prove the 
triangles congruent. Six of these 2 0 students failed to find a solution 
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Table I 

Protocol for the Base Aogles Theorem 



*1 

*2 
*3 



*4 

*5 
*6 
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S: Okay, so, I want to prove that angle A is congruent to 
angle B, Now, let's see. Do you want . . . ? 

Et Yeah . » » why are you drawing that line? 

S: I don*t know yet. Okay, xihm . . , okay, then I could , . . 
LC I drew a line • • . 

E: Mm-hmm, 

S: That would be the bisector of angle ACB, and that would 
give me • • • those congruent angles • • , no« (Pause*) 

Yeah> well that would give xtie those congruent angles p but 
I could have the reflexive property, so this would be equal 
to that* Okay, I got it., 

E: Now, before you go ahead and write it all down, when you 
said you w6re going to draw the line * • . 

S: Yeath • * . 

Ej And I sai,d, why are you doing that^ and you said you didn't 
know yet^ what do yoM think happened to give you the idea of 
making it the bisector ? 

S; Okay. Well, I have to try to get this • . 1 have to try to 
get triangle ACD congruent to BCD, because if I do that, 
then angle A is congruent to angle B because corresponding 
parts of congruent triangles are congruent. 

E: So you were drawing the line to give yourself triangles, is 
that l^e idea ? 

S: No, to • • . to get a side that was in both triangles. 

E: Okay. 

S: And to get congruent angles* 

E: So that's why you drew it as the bisector. 

S: Yeah. 




c 




Rgure 1- Diagram drawn by studant during 
solution given in Tabia l< 
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Given: M is the midpoint of aB and CD: 

AC a BD. 
Prove: Z.AMC ss /LBMO 



Figure 2. Problem of the kind studied by Luchins C1942) 
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to the problem in 2. 5 minutes that were allowed. In contrast, the 

problem was solved easily by all 12 students in a group who were 

given the problem without preceding problems to induce the attempt 

to prove triax^gles congruent* 
■ 

General Hypotlieaes 

The gist of the explanation of set and conatmctions to be proposed 
here is that both are consequences of the way in which planning occurs. 
The hypothesis to be proposed about planning is a hierarchical system 
that includes a set of plan-schennata that are associated with subgoals. 
Bach plan-schema includes information about global features of the 
situation that are required for the plan to be feasible; for example, the 
plan of proving triangles congruent requires that two triangles be 
present in the diagram. When a plan has been adopted, work proceeds 
in relation to the specific subgoals that are required for that plan to 
succeed. 

This planning system produces constructions by a process of 
partial pattern matching and pattern completion. Perdix recognizes 
that a situation partially matches a pattern that satisfies the prerequi- 
sites for a plan- schema and then activates productions that complete 
the required pattern. For example, a pattern that frequently enables 
the plan of proving congruence of triangles is a pair of triangles with 
a shared side. Before line CD is drawn in Figure 1. the diagram con- 
tains some but not all of the lines, angles, and points that constitute 
that pattern. A system that can detect that partial match and identify 
the discrepancy between the situation and the pattern it has in memory 
has the knowledge it needs to choose an appropriate construction for 
this problem. 

This idea also provides an explanation of problem- solving set. A 
plan may be adopted on the basis of global features, and because of 

8 
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the top-down nature of the syatem, the plan will becoxxie the basis of 
work on the problem until it either succeeds or it is determined thst 
the plan is impossible. For example, in Figure 2, the prerequisitefi 
are present for the plan of proving that angles are congruent by showing 
that they are corresponding parts of congruent triangles. If this plan 
is adapted, the system focuses on the subgoal of proving congruence 
of the triangles and can easily fail to notice that the angles are vertical 
angles* 

Planning Knowledge in Perdiac 

We will give a brief survey of the characteristics of Ferdix as a 
problem-solving system* More detailed information about Ferdix^ 
geometry knowledge has been given in other articles (Greeno, 1976, 
1977, 1978). 

■r>.. 

Perdix is a systexH^that solves problems by matching and completing 
patterns. It is a production system with a general control structxire 
adapted from Anderson's (1976) ACT system. The problem situation 
is represented as a semantic network. Points, lines, angles, and 
closed figures are represented by nodes. Connections between nodes 
include part-whole relations (e. g. , a point that is part of a line segment 
or a segment that is part of a triangle) and propositional structures 
that correspond to relations of congruence and other geometric rela- 
tions. 

The productions that constitute Perdix* problem -solving knowledge 
are in three categories: inferential principles, feature tests for pattern 
recognition, and strategic knowledge. The main problem*- solving steps 
are accomplished by inferential productions. These represent knowl-* 
edge of propositions such as ^'Vertical angles are congruent, or 
"Angles formed by bisection of an angle are congruent. The actions 
of these productions add relations to the semantic network that 

9 
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represents the situation; for example, if two angles have previously 
been identified as being vertical angles, the relation of congruence 
can be added between them* 

Simple pattern recognition is involved in the conditions that are 
tested in each production. More complex patterns are identified by 
sets of productions organized in the form of decision networks with 
terminal nodes corresponding to pti.tterns and relations that can be 
identified* Patterns and relations that are identified during problem 
solving are added to the representation of the problem situation* 

Strategic knowledge consists of productions for setting goals and 
adopting plans* Simple goal-setting involves associations that select 
productions that are relevant to the current problem -solving goal. 
More complex goals are set in the actions of productions and a push- 
down store memory is used to retain goals that must be recalled when 
their subgoals have been achieved. 

The theoretical development to be reported in this paper is a set 
of productions thac perform planning. Perdix' knowledge for planning 
consists of some global actions, or plan-schemata. The character- 
istics of plan-schemata are like those used by Sacerdoti (1977) in his 
theory of planning based on a procedural network. Goldstein (Note 1) 
used a similar organization of knowledge for geometry problems; his 
system includes experts that apply knowledge in specific topic areas, 
such as triangles or parallel lines. Each plan-schema in Perdix is 
characterized by three components of inforrxxation: (a) a set of pre- 
requisite features that make the plan promising, (b) pointer^ to 
pattern- re cognition and inferential productions that are used in exe- 
cuting the plan, and (c) tests to determine whether execution of the 
plan has succeeded. The procedures for plannlitg also include checks 
for a few salient features that wotdd allow the goal to be achieved 
directly without going through the usual process of planning and 
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executing a aeries of stops* Technically, these shortcuts could be 
classified as additional plans. 

In Perdix' knowledge structure^ plans are associated with gener- 
al goals. Seine goals are attempted directly through productions for 
pattern recognition* Other goals require propositional inferences. 
These latter goals activate planning productions. When one of these 
goals is generated during problem solving, a series of tests is per- 
formed. £ach test is an attempt to find the general features thavt make 
one of the plans for the goal promising. Kach planning system is thus 
a pattern recognizer in which each identifiable pattern corresponds to 
a set of features needed to make one of the plans promising. 

Two planning systems have been implemented in Perdlx. One is 
associated with the goal of finding the measure of an angle» and the 
other is associated with a category of goals of finding or proving a 
quantitative relationship such as congruence between two angles or 
two segments. One plan for finding the measure of an angle uses the 
sxim of angles in a triangle. The other uses a quantitative relationship 
with another angle. The planning system is essentially a decision tree 
that chooses one of these plans, based on whether the unknown angle 
is part of a triangle and on the nature of available information about 
the measures of other angles in the situation. 

We will describe the planning system for inferring quantitative 
relations in some detail. Perdix has three plans for inferring quan- 
titative relations between angles or segments. It can infer congruence 
between angles or segments that are corresponding parts of congruent 
triangles. This plan is abbreviated TRICONGQREL: TRIangle CON- 
Gruence is used to infer a Quantitative RELation. A second plan uses 
relations between angles with a shared vertex: RTNRELQREL means 
that a relation based on rotation, RTNREIL, is used to infer a Quan- 
titative RELiation. The third plan uses relatione between angles with 
parallel sides: PRL.R£:lQREL« 

11 
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The procedure that has been implemented for constructing aux- 
iliary lines is part of the planning system for quantitative relations. 
If none of the preconditions for Perdix' three main plans is fo\ind, 
Perdix can identify a partial match to a pattern that provides the pre- 
requisites for one of it© plans, the congruence of triangles. If a 
sufficient subset of the features of that pattern is present^ Perdix 
completes the pattern and will then choose the plan that its own con- 
struction has enabled. 

Figure 3 shows the components of the planning procedure for 
finding a quantitative relation between two angles or segments. VI 
and VI 1 denote the angles or segments in that goal. There are tests 
at (l)^ (2), and (3) for a few features that can provide q\iick solutions. 
Next, at (4), Perdix tests whether the target elements are parts of 
triangiea* If they are, triangles are tested a^ (5), (6), and (7) to see 
whether* -Jriere are features that would make it feasible to try to prove 
tiiat tht^y are congruent* These tests have two functions. First, if 
the -:ri,aiTgleo are not promising, the system can look for other plans 
chat might be easier. Second, since many diagrams include more 
aian one pair of triangles, the tests at (5), (6), and (7) serve to select 
triangles ti xit contain congruent components. If one of these tests is 
successful then at (8), the plan is adopted to find a quantitative relation 
basod on congruent triangles, and at (9) the goal is set to show that the 
selected tr?angles are congruent. 

If promising triangles are not found, Perdix tests at (10) and (13) 
for features of its other general plans for finding quantitative relations. 
If the targets are angles with a single vertex then at (11) the plan 
RTNRELQREL is adopted xx> infer a quantitative relation from a rela- 
tion based on rotation, and at (12) the goal is set to find a relation of 
rotation between the angles. The system will then engage in pattern 
recognition that can identify vertical angles, linear pairs, or angles 

12 
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bindintlMor 
Mpmti: VI, VII 




forxxied by perpendicular lines^ If the test at (13) ehowQ that the 
angles are formed by parallel lines intersected by a transversal, then 
at (14) the plan PRLRELQREL is adopted to infer a qtiantitative re- 
lation froxn a relation involving parallel sides. Under the goal PitLREL, 
set at (15)^ Perdix will perfonxi pattern recognition that can identify 
corre8x>onding angles, alterxauate interior angles, or interior angles on 
the same side of the transversal. If these plans are not feasible, 
Perdia: will try to use triangles that seemed impromising earlier, if 
they are found in the test at step (16}« 

The proceas for constructing auxiliary lines is used if the test at 
(16) is negative. If the prerequisite features of none of the available 
plana are present, Perdix checks whether the problem situation has 
features that provide a partial match for a schema that includes the 
prerequisites for one of the plans. The schema consists of a pair of 
triangles with a shared side* It contains 11 components: two triangles, 
five segments, and four points. The partial match can consist of two 
segments that intersect, foxuid at (17), and either of two further con- 
ditions; two additional intersecting segments at (18), or a single 
segment found at (20) that can be divided to form two needed segments. 
If the appropriate components are found, Perdix constructs a segment 

that completes the pattern at (19) and returns to the top of the planning 
1 

process. 



The part of the system in which the productions for construction 
interact with the present planning system has not been debugged. At 
its present size the system is relatively expensive to work with, and I 
believe that only technical insights would be gained from completing 
the programming task. The prodtictious for construction were debugged 
in an earlier system, described at meetings of the Niidwestern Psycho- 
logical Association In 1976, in which the decision to construct a line 
was made when conditions for^ setting a subgoal of congruent triangles 
were satisfied. 
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If the features needed to perform this construction "are not present, 
then the system adopts the goal of finding a chain of relations between 
angles at (22). This is a kind of default plan, involving an attempt to 
find some third angle that is congruent to one of the angles that can 
then, be related to the other target, perhaps through mediation of fur- 
ther linking angles. 

When the planning process is finished, one of three things will have 
happened. First, the goal may be achieved on the basis of a feature 
permitting a quick solution. Second, a plan may have been chosen, and 
this generally involves setting a subgoal that will permit the plan to 
•work. Adoption of a plan may have been preceded by a construction to 
make the plan feasible. FinaUy, the system' s planning knowledge may 
be insufficient for the problem at hand, and th'^re may be no successfiil 
outcome for plajming. (In the system shown in Figure 3 this leads to 
setting the goal of forming a chain of congruent components. ) In the 
situation whore a plan is chosen, the system then executes procedures 
that are associated with the plan, including pattern- re cognition and 
prepositional inferences. 

Explanation of Constructions and Set 
The planning process in Perdix is an example of one kind of knowl- 
edge structure that can produce constructions and set. The relevant 
general feature is the knowledge of global actions and planning systems 
that choose a general approach to the problem from among the avaU- 
able global actions. Figure 3 is an example: the alternative global 
actions are called TRICONOQREL, RTNRELQREL. and PRLRELQREL. 
The planning system uses general features of the problem situation 
such as the presence of triangles with known relations between their 
components to select one of the global actions as a plan. 



The g^eneral idea about constructions illustrated in JPerdix involves 
knowledge of prerequisite features for plans and the ability to recog- 
nize partial satisfaction of a set of prerequisites. When Perdix finds 
that the prerequisites for none of its plans are satisfied, it can recog- 
nise that the situation has some of the components of a pattern that 
permits TRICONGQREL to be used. Perdix lias problem- solving pro- 
cedures that perxxiit'lt to complete thi& pattern, and thus produce the 
prerequisites that are required for its planning system to choose a 
global action* This illustrates a general kind of process in -which 
knowledge of needed prerequisites permits a system to identify an 
auxiliary problem. The new problem arises because the situation io 
discrepant from conditions known to be prerequisites for making prog- 
ress on the main problem. In a hierarchical system, a deficit that 
arises at "the level of global actions can generate an auxiliary problem 
that is solved in a problem space different from the space of the main 
problem. In the geometry example, the operators for the main prob- 
lem are inferential propositions such as, "Vertical angles are con- 
gruent* The operators in the auxiliary problem space are a set of 
rules for adding lines to a diagram ouch as **Two pointii may be con- 
nected by a line segment, " or "The bisector of an angle can be 
constructed, " The process of identifying a deficit in the main problem 
space cona'dtutes a form, of problem finding, and thus provides some 
insigut into creative problem solving (Getzels & Csikszentmlhalyi, 
1976) and solution of ill-structured problems (Simon, 1973). 

The occurrence of set is es^lained in a straightforward way by the 
top->down nature of the planning system. Consider the problem shown 
in Figure 2. The two alternative solutions correspond to different 
plans, one involving congruent triangles and the other involving a 
relation between angles having the same vertex. Whether Perdix 
finds the simple solution involving vertical angles or proves that tri- 
angles are congruent depends on the order in which the productions 
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testing feasibility of these plans are included in the production list. 
In the cpnfiguration shown in Figure 3, the features needed for the 
plan of congruent triangles are tested before the feature needed 
for the plan of a relation involving rotation. With the productions 
ordered in this way, Perdix agrees with the majority of LuchLns' sub- 
jects on the way to solve problems like Figure 2, The test "VI, VI 1 
in triangles? " passes as docs the subsequent confirming test, "VI, 
Vll in triangles with sides or angles congruent? " This leads to adop- 
tion of the plan to prove the triangles congruent, and the system works 
on that subproblem and eventually succeeds in solving the problem by 
proving the triangles congruent by side- side- side. 

The relative strengths of productions are represented in Perdix 
by the order in which their conditiona are tested. For examplo, the 
test for "VI, Vll angles with shared vertex?" could be performed 
hefore "VI, Vll in triangles? " and in that case, Perdix would find 
the simpler solution based on vertical angles. The mechanism involv- 
ing ordered productions is not intended as a plausible hypothesis about 
the way in which stronRer productions dominate performance; other 
systems such as Andcj son's version of ACT (1976) or the OPS system 
(McDermott & Forgy. 1977) include a variety of mechanisms that have 
greater psychological plausibiUty. It would be natural to assume that 
the strength of a production would b^e increased by the major facto-'s 
that are usually assumed to influence set, such as the frequency and 
recency of successful use of a plan in problems similar to the present 
one. The present analysis does not provide any new ideas about the 
way in which set occurs. The contribution of this analysis is in 
showing that the knowledge structures responsible for set may be the 
same as those that are responsible for planfulness and creativity in 
problem solving. 



18 

ERIC 



Experiments on Construction s ajid Set 



The rsiodel described above provides a way of interpreting the 
reeiiits o£ three escperiments we ha.ve conducted. The first experi- 
ment involved a problem reqtiiring a simple construction. The problem 
was presented in two different fo'rms, and in one form the construction 
was produced by a greater proportion of subjects than in the olther. A 
plausible interpretatioi^ of the difference between the two forms can be 
given in terms of the planning model that we have presented* 

The second experiment used the same problem as Experriment I. 
We investigated condition;!? that could be expected to make it more likely 
that subjects would produce the construction needed for solutica in the 
iiarder version of the problem. One of the conditions th5^,t we used was 
successful in making tliat version of the problem easier, and the effect 
is consistent with the idea of pattern-based plaztning that is incorpo- 
rated in Perdlx. 

The third experiment was a traditional study of set, and focused 
on a problem reqpiiring a conc&truction* We used a problem that has 
two solutions, one based on parallel lines and the other based on con- 
gruent triangles. We gave different groups of subjects different series 
of problems before presenting the ambiguous problem. The problems 
i3 one induction sequence used parallel lines and the problems in the 
other induction sequence used congruent triangles. The majority of the 
solutions that subjects chose for the ambiguous problem agreed with 
the plan they had been using, and this result agrees with tbe interpre- 
tation of problem-solving set that we have given based on the model of 
scliematic planning vr^^c^^^d above. 

Experiment I 

The ejq>eriment involved two problems presented to different 
grox^B of subjects* Both problem^s used the diagram shown in Figure 
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4, Point 0 is tlie center of the cif de, and BC is a diameter. In the 
problem given to one group of subjects, given information included 
the measxirc of arc AC, 80 degrees, and the goal was to find the mea- 
sure of the angle ^BC. In the other form, the measure of ^BC was 
given aa 40 degrees, and the goal waa to find the measure of arc AC. 
To solve either problem, a subject had to give a series of steps jus- 
tifying each inference, as is customary in high-school geometry. The 
solution of either problem depends on making the construction AO. 
This creates the central angle ^OC, and by definition the measure 
of a central angle and the measure of its intercepted arc are the same. 
Construction of AO also creates an isosceles triangle &OAB, with sides 
OA" and OB that are congruent, being radii of the circle. The angles 
at A and B, ^AB and jiABC, are congruent since they are the base 
angles of the isosceleu triangle. Using these relationships, a solution 
for problems with the axe given is as follows: (a) measure of arc AC 
is 80 degrees (given), (b) construct segment AO, (c) measure of ^AOC 
ia 80 degrees (central angle), (d) measure of ^OB is iOO degrees 
(linear pairs are supplementary), (e) sum of measures of ^AB and 
/ABC is 80 degrees (s^lm of angles in a triangle is 180 degrees), and 
(f) measure of ^BC is AO degrees ( ZPAB and ^BC are equal). A 
solution for the problem with the angle given is as foUows: (a) measure 
of UiTSC is 40 degrees (given), (b) construct segment AO, (c) measure 
of ZPAB is 40 degrees ;base angles of isosceles triangle are equal), 
(d> measure of ^OB is 100 degrees (sum of angles in a triangle is 
180 degrees), (e) measure of ^AOC is 80 degrees (linear pairs are 
Bupplementary), and (f) measure of arc AC is 80 degrees (arc inter- 
cepted by central angle). 

Method. Subjects were students in introductory psychology at 
the University of iHttaburgh who participated to fulfill a course require- 
ment. Fifty-three subjects were given the problem with the angle 
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given, and 52 subjects were given the problem with the arc given. 
Subjects participated in groups of up to six in size. 

Experimental sessions began with a review of geometric concepts 
needed to solve either problem, including the congruence of base angles 
of an isosceles triangle, the relation between an exterior angle and its 
opposite interior angles in a triangle, and the definitional equality of 
the measure of a central angle and the arc it intercepts on a circle. 
The review of concepts was given in the form of 10 problems, which 
were worked individually by the subjects in the group. The experi- 
menter monitored the subjects' work and explained how to solve any 
problems that any subjects were xinable to solve. The experimenter 
also called attention to features of the various training problems that 
were relevant to the critical problem. The 11th problem in the series 
was Figure 4. with either the meastire of arc AC or the measure of 

ABC given and the other unknown. No assistance was given on this 
problem, and four minutes were allowed for solution of the problem. 
At the end of tho aUotted time, subjects v/ho had not solved the problem 
were asked to turn to a second sheet containing the same problem, and 
were given the hint that a line drawn between points A and O would be 
helpful in solving the problem. An additional four minutes were allowed 
to see whether the subjects could solve the problem with the hint given. 

Results. The problem with the arc given was considerably easier 
than the problem with the angle given; proportions of subjects solving 
the problem in the initial four minutes were . 731 and . 471. respec- 
tively. The difference is statistically reliable; x = 7-34, 

An Important question for our theoretical interpretation involves 
the degree to which the difficulty of the problem with the angle given 
was caused by a difficulty in seeing the correct construction. Of the 
28 subjects who had the angle given and failed to solve the problem, 
seven drew the correct construction during the initial four minutes of 
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work; of the 14 subjects who had the arc given and failed to solve, two 

drew the correct construction during the initial four xninutes. If these 

subjects are counted along with the subjects who solved, the difference 

between the conditions is attenuated and becomes marginally nonsig-* 

2 

nificant: .769 vs • 604, x (D = 3.32, .05 < £ <• 10. However, the 
status of these unsuccessful constructions is unclear. Only two sub- 
jects showed evidence in their protocols of relating the construction 
to appropri9ite relational patterns (one of the seven subjects with the 
angle given mentioned the isosceles triangle, and one of the two sub- 
jects with the arc given mentioned the central angle). An alternative 
interpretation is that some subjects who failed to see the correct 
pattern simply drew an additional line in the diagram somewhere, and 
the signlficauice of the constructed line was not evident in many cases. 
It may be noted that irrelevant constructionB were inserted by nine 
subjects: a radius perpendictdar to the diameter was drawn by seven 
subjects (six with the angle given, one with the arc given) and points 
A and C were connected by two subjects (one in each condition). 

There was also some marginal evidence that the problem with the 

arc given was easier than the problc&m with the angle given when the 

construction was given as a hint» Thirteen of the 14 subjects who had 

the arc given and failed to solve in the first four minutes did solve 

after the hint was given; 20 of the 28 initial nonsolvers who had the 

angle given solved the problem after the hint was given. The difference 

2 

was marginally nonsignificant: .929 vs .714 x (1) = 3. 18, .05 < SL < 
.10. 

mscus eion. The major finding of the experiment was that the 
problem with the arc given was easier to solve than the problem with 
th.e angle given. The most reasonable conjecture is that the difficulty 
had two sources: First, subjects were apparently somewhat less 
likely to generate the needed construction when the angle was given; 
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second, tiie sequence of inferences was apparently harder to find with 
the angle given, even when the segment AO was present in the problem 
situation. 

An interpretation of the resiilt can be given usiixg the idea of 
8 chexnatic planning. A relevant fact is that student subjects usually 
work forward in geometry problems. Subjects who were given the 
measure of the arc probably tried to find features of the problem re- 
lated to the arc, and subjects who were given the measure of the angle 
probably tried to find features of the problem related to the angle. It 
seems reasonable to suppose that the pattern of the central angle was 
relatively easy to retrieve with the arc as a cue- The measure of the 
arc and the meastire of the central angle are related definitionally. and 
the central angle is a rather simple pattern. On the other l and, it was 
probably less likely that the pattern of the isosceles triangle formed 
by radii wotdd be retrieved with the inscribed angle as a cue. There 
is no direct definitional connection between the measure of the inscribed 
angle and the triangle formed by radii of the circle, and that pattern 
is somewhat more complex than the inscribed angle. Thus, it seems 
reasonable that the greater difficulty of the problem with the angle 
given was caused at least partly by a lower probability of retrieving 
the pattern from memory that was needed to provide a basis for planning 
the first major step in the solution of the problem. 

Experiment II 

This study e3q>lored two ways of providing experience that might 
facilitate solution of the harder form of the problem of Figure 4, One 
way to make solution more likely would be to increase the probabUity 
of retrieving the pattern involving an isosceles triangle formed by 
radii of the circle. A second possibility would be to induce a strategy 
of planning backward from the goal of the problem; this could lead 
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subjects to consider problem components that can be related to the 
measure of the arc» and thus to retrieve the pattern involving the 
central angle# 

Methods. Three conditions were used* A control condition was 
identical to the condition used for the problem with the angle given in 
Experiment I* For the other two conditions , the sequence of review 
problems was condensed to seven problems and three additional prob- 
lems were included. For the isosceles-pattern condition^ the three 
added problems involved isosceles triangles that were formed by radii 
of circles. For the backward-planning condition^ the iiiree added prob- 
lems involved solution sequences that were easier to find by working 
backward from the goal than by working forward from the given infor- 
mation. In the backward«*planning condition, the experimenter specif- 
ically instructed the subjects to find a sequence of steps that started 
with the unknown cpiantity and progressed toward the given information 
and coached them so they identified appropriate sequences for the three 
problems. 

The procedure was the same as in Experiment I, with the problem 
of Fifnire 5 presented as the 11th problem in all three conditions with 
the measure of ^BC given and the measure of arc AC the goal. Two 
groups of subjects participated: 86 students from introductory psy- 
chology at the University of Pittsburgh who participated to fulfill a 
course requirement and 81 students who answered an advertisement 
in the campus newspaper who were paid for their participation. The 
numbers of subjects from these two sources in the three conditions 
were as follows: control, 28, 27; isosceles paUern, 29, 28; backward 
planning, 29# 26. 

Results. The proportions of subjects who solved the problem in 
the three conditions were as follows; control, .436; isosceles pattern, 
« 649; backward planning, . 527. The difference was not quite large 
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enough to give a significant teat statistic: X (2) = 5. 14, .05 * ^ * 

. 10. However, a chi- square statistic involving just the control and 

2 

isosceles -pattern conditions was significant, X (1) = 5. 10, < .025, 
and the results for the two groups of subjects were very consistent, 
providing some additional confidence. Proportions of solvers from 
introductory psychology were .500, .724, and c 586; proportions of 
paid subjects who solved were .370, .571, and .462. It seems rea- 
sonable to conclude that solution was made more probable in the 
isosceles-pattern condition. A conclusion is not warranted regarding 
the backward-planning condition; it may have provided no facilitation, 
or it may have facilitated problem- solving as much as the isosceles- 
pattern condition. 

A substantial n\imber of nonsolvers added the appropriate construc- 
tion to the diagram, although they failed to solve the problem using it. 
Of the 31 nonsolvers in the control group, 15 added AO to the diagram 
in the first four minutes of work. Of the 26 nonsolvers with backward- 
planning induction, nine added AO; and six of the 20 nonsolvers with 
the isosceles pattern added AO. The proportions (including solvers) 
who made the correct construction were: control, .709; isosceles 
pattern, .754; backward planning, . 691. These were clearly not sig- 
nificantly different. Again, the status of the correct constructions by 
nonsolvers is uncertain. Thirteen of the 30 correct constructions 
made by nonsolvers were accompanied by addittonal lines in the dia- 
gram that were not useful in the solution, and 21 of 47 subjects who 
did not make the correct construction added some line ot lines in 
their attempts to solve the problem. It seems likely that relatively 
haphazard modifications of a diagram can be made by subjects, and 
some of the constructions in our experiments must have been of that 
nature. Perhaps the best interpretation of the results is that training 
with the isosceles pattern increased subjects' abUity to identify the 
pattern and thus to produce a wellrmotivated construction. 
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The effect of giving the hint to draw line AO was inconclusive. 

Proportions of initial nonsolvers who solved the problem following the 

hint were « 613, • 750^ and • 654. The resiilt is not inconsistent with 

the Idea that the backward-planning and isosceles -pattern conditions 

facilitated problena solving with the completed diagram as well as 

facilitating making the construction, but the difference was far too 

2 

small to be significant, x (2) = 1« 03, > • 50. 

Discussiom The facilitation of problem solving in the isosceles- 
pattern condition is consistent with the hypothesis of a planning system 
that is based on knowledge of patterns that are identified as conditions 
for adopting plans, and that are used in making constructions that take 
the form of pattern completion. Our interpretation is that the additional 
problems given with the isosceles pattern made that pattern more sa- 
lient for subjects, and thus made It more likely that they would retrieve 
that pattern from memory in the problem sitxiatiLon. 

Experiment III 

This eatperiment involved the role of problem -solving set in a 
problem requiring a conatruction* Our explanation of problem- solving 
set given above is that the pattern-based planning system becomes 
biased toward choice of a plan that has been successfully used in recent 
problems* Our explanation of constructions is that a pattern associ" 
ated with a plan is partially identified, and the system completes that 
pattern in order to have the prerequisites for a plan. This suggests 
that if a problem can be solved with alternative constructions related 
to different plans, the construction that is chosen should be influenced 
by a series of problems that are solved using one or the other of the 
two plans. 

The problem used in the experiment is shown in panel (a) of 
Figure 5. The problem can be solved by showing that triangles are 
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(a) 

Opposite sides of a parallelogram are equal and parallel. 
Show that opposite angles are equal, that is, LA » lD, 



B 




(b) 




B 



D 



Given: ^BDE - LABD 
AB - DE 
Z.ACD - 55° 

Find: i-CAB 



Rgure 5. Problems u$«d in experiment on constructions and set. 

—continued" 
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(c) 




Given: 

BD and AF bisect each other. 
Z.CFO - 65° 
AABC - 75' 

Rnd: Z.ACB 



Figures (continued). 
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congruent. This requires constructing the diagonal line BD; the re- 
sulting triangles are congruent by side -side -side. The problem can 
also be solved using relations based on parallel lines. This solution 
usually uses a construction such as extending line BD upward. In this 
case* IJk is congruent to the exterior angle at B (alternate interior 
angles) and that angle is congruent to S> (corresponding angles). 

Method. The subjects were 12 University of Michigan students 
who were paid for participating. Thinking-aloud protocols were tape 
recorded to permit later identification of subjects' solution strategies. 
The experimental sequence began with a series of review exercises 
that reminded the subject of ideas involved in proving congruence of 
triangles and in proving theorems involving angles formed by parallel 
lines and an intersecting transversal. Then there was a series of 14 
induction problems. For six subjects the induction problems all used 
congruent- triangles; the other six subjects had 14 problems that used 
relations between angles based on parallel lines. The 15th problem 
for al3 subjects was the problem shown in panel (a) of Figure 6. After 
this ambiguous problem, each subject received a problem that required 
use of the plan that had not been used in the induction sequence that 
the subject had received. These problems did not require constructions, 
but gave a f\irther opportunity to observe the biasing effect of problem- 
solving set at the level of general planning. For subjects who had been 
induced to use congruent triangles, the 16th problem was the one shown 
in panel (b) of Figure 5. This is an easy problem using parallel lines: 
AB and CE are paraUel ( ^DE and ^BD are alternate interior angles); 
hence. ^CD and jjCAB are supplementary {interior angles on the same 
side of the transversal). The 16th problem for subjects who received 
induction of parallel lines is shown in panel (c) of Figure 5. The tri- 
angles are congruent by sid«-angle-side, because of vertical angles; 
then ^AC - 65 degrees (congruent to ^FD), and ^CB can be found 
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by aubtraction from 180 degrees. For the subjects with induction of 
congruent triangles^ panel (c) was the 14th problem; for the subjects 
with induction of parallel lines^ panel (b) was the 14th problem. This 
permitted comparison between subjects for whom the problem was 
consistent with the induction series and subjects for whom it was not. 

Results ■ The manipulation was strong enough to produce reliable 
differences, even with only six subjects per condition. In the ambig- 
\xous problem, panel (a), five of the subjects who received induction 
with congruent triangles solved the problem by constructing the diag- 
onal and proving that the resulting triangle*) were congruent. Only one 
of the six subjects who were induced to use parallel lines found the 
proof based on triangles; the other five found proofs using relations 
formed by parallel lines. The difference is significant. ^ . 02, on a 
sign test where the random event is agreement between the subject^s 
solution and the induction sequence* 

The problem in panel (c) of Figure 5 must be solved by proving 
that triangles are congruent. All six subjects who were induced for 
congruence of triangles adopted a plan involving triangles initially. In 
the group induced with parallel lines, only two subjects initially worked 
with a plan for proving the triangles congruent; the other four subjects 
tried to use the relation of parallel lines. This is also significant by 
a sign teat, ^ <• 02. 

The problem in panel (b) of Figure 5 is solved using parallel lines. 
In the groxxp where induction was with parallel lines, four of the six 
subjects used the plan involving parallel lines initially; the other two 
failed to see that parallel lines could be inferred but mentioned parallel 
lines as a subgoal. In the group where induction was with congruent 
triang^es^ three of the six subjects began with a plan involving con- 
gruent triangles and only one used parallel lines; the other two subjects 
initially used a plan involving the stun of the interior angles of a 
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qiiadrilateral. Counting just thoae subjects whose inltiail plan was 
either congruence or parallel lines, the difference betrveen the con- 
ditions was significant with £ <. 04 by a sign test. 

Discnasion. This experiment on set provides a supporttve illus- 
tration of the idea of a strong connection between the process of making 
constructions and the process of planning. The idea that a single 
planning process is responsible for both problem -solving set and the 
making of constructions seems a plausible one. 

Thinking -Aloud Protocols 

A collection of thinking -aloud protocols was obtained from six 
students who were interviewed individually approximately on<:e each 
week during the year in which they took a cotxrse in high school «eom- 
etry. In the interviews, students solved a wide variety of problems, 
only some of which are relevant to the issues In this paper. Solutions 
of nine of the problems used constructions, and two of the problems 
provided illustrations of problem-solving set. Protocols from these 
problems were examined to provide an informal evaluation of the 
general hypothesis of schema-based planning processes. A brief 
summary of the conclusions of this informal analysis will be given 
here. A more detaUed discussion of the protocols from the nine prob- 
lems involving constructions is avaUable in a technical report (Grceno, 
Mote 6). 

Problems Involving Constructions 

Plan-based constructions. Nine problems that were given required 
construction of auxiliary lines. Most of the protocols indicated solu- 
tion processes that were generally consistent with the kind of process 
programmed in Perdix, where constructions are related to schemata 
that function as plans. Various schemata were involved in the different 
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problems^ including formation of triangles and other geometric figures 
and the central angle of a circle. 

An example involving the pattern of parallel lines intersected by 
a transversal is shown in Figure 6, This example has special interest 
be c&use diff erent constructions were used by subjects^ based on dif* 
ferent schemata. This problem was given to students early in the 
course, before they had studied congruence of triangles. They had 
been taught about relations between pairs of angles with parallel sides, 
such as corresponding angles, alternate interior angles, and so on. 
Constructions used in solving the problem are shown in panels (b), (c), 
and (d)« The construction shown in (b) completes transversals that 
Intersect the parallel lines by extending lines already in the diagram. 
The protocol in which (b) occurred indicated that the subject probably 
completed the pattern and m^de justified inferences based on alternate 
interior angles, and then realized that the presence of triangles per- 
mitted further inferences, which then led to the solution. The subject 
who gave the construction in (c) specified the added line as the perpen^ 
dicular going through the vertex, and apparently foresaw using the 90 
degree angles to permit Inference of the remaining angles in the tri- 
angles based on the sum of angles in a triangle being 180 degrees. At 
the time this problem was presented the class had not studied triangles 
so the sum of angles of a triangle was recalled from earlier study by 
the subjects who used (b) and (c). The construction in pansl (d) per- 
mitted solution without using the triangle-simi property. This con- 
staruction was not used by any subjects, on the problem in panel (a), 
although one subject saw that it could be used when a pattern of three 
parallel lines was presented in another problem, and another subject 
used it in an other construction problem involving parallel lines. 

Working-forward pattern completion. While most of the protocols 
were consistent with Perdix' procedure for constructing auxiliary lines 
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several included significant features that could not be simulated by the 
kind of procedxire that has been programmed* One process involves 
pattern completion that does not seem to be directly related to the 
problem goal. An eicample occarred in a problem of proving that if 
sides of a triangle are unequal, the angles opposite those sides also 
are \mequal. This ^problem requires a construction to form an isos- 
celes triangle inside the given triangle. One student made a construe * 
tion similar to the one in Figure 1, bisecting the angle between the two 
specified sides of the triangle. It seems likely that features of the 
problem reminded the subject of the pattern involving two triangles 
containing the angles in the problem goal* Ifoweverp that pattern is 
not a useful one for proving inequality of angles. 

Procedures for making forward-v^rking constructions have not 
been programmed for Perdix; however, they are quite straightforward. 
The kind of process needed could be represented either as single pro- 
ductions activated b^ features of the situation with actions that add the 
au xilia ry lines or set goals for adding lines. An example relevant to 
the problem U'.3ed in Experiments I and II would be a production in 
which the condition is an arc of a circle with known measure and the 
action is construction of the central angle corresi>onding to the arc. 

In order for a construction produced in working forward to be 
useful, there must be a procedure for recognizing the results of the 
construction tha.t may be helpful in achieving the goal of the problem. 
The planning process represented in the present version of Perdix is 
suited well for tliat purpose, since the plaxming procedure consists of 
a pattern recognition system for identifying features that are favorable 

..lo available plans. Thus, if a forward-working production were 
to produce a new feature of the problem that could enable choice of a 
plan, the system would only have to invoke its planning system in the 
usual way for that new feature to be recognized and used. For 
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ejcample» in the problem used in Ejcperiment I the construction of the 
central angle produces a triangle that has the unknown angle as one of 
its components. This configuration of features is then available for a 
plajoning process that has the form of a pattern-recognition system. 

A problem that must be solved in a system that includes forward 
chaining is that many inferences may be generated that are not useful 
in the problem* This would become especially critical in a system 
that permits use of auxiliary lines, since this greatly increases the 
number of potential objects about which inferences might be made. 
Nevins (Note 7) and Ullman (Note 8) have given some attention to this 
difficulty in systems for geometry theorem proving. Nevins' system 
restricts forward- chaining inferences to those that are related to 
generally useful subgoals that he called paradigms, such as finding 
congruent triangles- Ullman' s system applies a general criterion of 
compactness of inferred information, such as the inference that a 
closed figure is a parallelogram, for setting aside the process of 
forward-chaining. It seems quite likely that some mechanism such as 
these would keep a process of forward- chaining \mder control in Perdix, 
especially if forward-chaining were used only when none of the plans 
that the system has provide a basis for progress. 

Stages in specifying constructions. Another feature of some pro- 
tocols that would require extension of PerdLx occurred when construc- 
tions had to be given some geometric property in addition to the spatial 
features used in drawing the line. A construction in geometry is often 
added in a single step, for example, by connecting two points in the 
diagram. However, some constructions are more complicated, re - 
quiring specification of some geometric property in addition to simply 
locating a line in the diagram. An example is the construction used 
in proving that base angles of isosceles triangles are congruent. In 
Table 1, there is a dear indication that the subject drew the line that 
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completed the pattern of two triangles and then chose the specification 
of the line as the bisector of the angle at point rather than identi- 
fying the construction as the angle bisector initially. 

Geometry constructions illustrate a general feature of problems 
in which znaterial added to the problem space must satisfy constraints » 
In geometry^ the constraints a:re specified in a set of theorems that 
assert that certain constructions are permitted. An example of such 
a permissive theorem is that an angle has exactly one bisector^ which 
is used to justify construction of the bisector of an angle. Students are 
taught that an auxiliary line added to a diagram should not be either 
underdetermined or over determined. That is, just enough conditions 
should be specified for the line that exactly one line can be drawn to 
meet the conditions. 

The process of forming a construction apparently has two major 
components* One is a process that motivates the construction, and 
the other specifies properties of the construction that satisfy constraints. 
The analysis given in this paper has dealt mainly with the process of 
motivating a construction; protocols seem consistent with the idea that 
constructions are motivated by knowledge of patterns in pla^ schemata 
that can be completed by adding auxiliary lines. The process of sat- 
isfying constraints is relatively simple in geometry, where permissive 
theorems give a complete list of the conditions that may be used. When 
a problem solver encoimters a situation in which an auxiliary line is 
desired, the construction theorems are consulted and the construction 
is added if the conditions of a permissive construction theorem are 
satisfied in the situation. 

Three distinguishable patterns of forming constructions of this 
kind occurred in the protocols available for this study. In one pattern, 
found in two of the five protocols for the base angles theorem, sub- 
jects specified the construction completely at the outset. A second 



way of forming the constniction shown in Table 1 smd by one other 
subject involved drawing the line, then giving the geometric specif- 
ication in relation to a goal of the problem. In this case, the goal is 
to generate components of triangles that can be proved congruent, and 
by specifying the aiudliary line as an angle bisector there are congru- 
ent angles. The third way of forming the construction involved drawing 
the line, then giving a geometric specification that was not related to 
the goal of the problem in any definite way. The subject who showed 
this pattern drew the line, then said, "I would probably say that this 
is a median. " After completing the problem, the subject answered a 
question about the construction by saying, "All I wanted was just a 
name for a line that was going to give me two triangles. " 

In its present form, Perdix satisfies multiple constraints on con- 
structions because its productions for construction have appropriate 
specifications as parts of their actions. This is inconsistent with 
most of the constructions observed in the protocols used in this study. 
Most of the time when an angle bisector or a line parallel or perpen- 
dicular to a given line was constructed, there was no evidence of special 
consideration given to the legitimacy of the construction. Of the three 
escamples in which permissive theorems seemed to be used, one was 
consistent with the process used by Gelernter's system (1963), in 
which the need for the construction arises as a subgoal and there is 
explicit checking of the permissive theorems stored as a list to see 
whether a justification can be found. In the other two cases, a speci- 
fication was apparently chosen in order to satisfy subgoals that were 
anticipated for a later stage of the problem. This kind of antici- 
patory plaxming has not been implemented in Perdix, but it is not 
incompatible with the general kind of planning mechanism that Perdue 
uses. In Sacerdoti's (1977) model NOAH, unboxind variables can be 
included in high-level comjionents of plans, so that further analysis 
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can be performed before deciding precisely how to specify the actiona 
that will be performed. 

Problems Involving S et 

Two problems were given that could be solved either -by ratios of 
sides of special right triangles or by congrnence of triangles » Simpler 
solutions could be obtained using congruence, but the class topic at the 
time was properties of special triangles, and a ms^^jority of the solutions 
obtained used that approach. 

These protocols give further illustrations of the idea that general 
aj^roaches to problems can be influenced by recent use. The c\arrency 
of the properties of special triangles in the geometry course apparently 
provided a contesct that was sufficient to induce a problem -solving set 
for most of these subjects. On the other hand, examination of the 
protocols provided evidence against the specific form of pl annin g that 
is used in Perdiac to ejcplain problem- solving set. Perdiac has plans 
associated with goals and checks these plauas one at a time u nti l one of 
t»itf>TTi is selected. Performance by some subjects was more flexible, 
involving inference of some propositions in an apparent working- 
forward process and consideration of congruence of triangles. One 
subject in thinking retrospectively about solving a problem said, '*I 
wondered why you were giving me these things, and I went at the prob- 
lem saying, well, let me try and use these things, and I said, well, I 
give xspm Or, I give \rp, I see there* s an easier way in my mind. But 

I I was working on it until I saw that things just came more naturally 

in another direction. " 

Performance of some human subjects would be simulated more 
accurately if Perdix* planning productions covild be tested occasionally 
during problem solving. Plan- schemata could be represented as 
structures that have some probability of being activated at any tirr^-^ 
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during problem solving^ rather than only at the time a goal is acti- 
vated. Effects of set could still be aimulated if the probability of a 
plan- schema's activation depended on the strengr^s of relevant pro- 
ductionStf and these strengths were influenced by factors such as recency 
of successful use of the various plans in the system (cf • Anderson, 
1976; McDermott ic Forgy, 1977). 

General Discussion 

This final section includes comments on the relationship of con- 
structions to the general question of ill- structured problem solving 
and creativity, and on the general issue of problem- solving set. 

Constructions in 111- Structured Problems 

A property of many ill- structured problems is that the problem 
space initially given in the problem is insufficient for the solution to 
be achieved. The initial situation may contain few if any of the com- 
ponents that are eventually generated and brought together in a solution 
of the problem. Examples that are often used include problems of 
composition, such as music, poetry, paintings, or scientific articleb, 
where the problem solver adopts the goal of composing something^ and 
creates most of the elements of the problem space as v. as their 
arrangement in order to solve the problem. 

Geometry problems are not poetry, of course, but problems with 
constructions seem to provide a nontrivial but manageable case in which 
the initial problem, space must be enriched in order for the problem to 
be solved. In the model we have described in this paper, constructions 
are required when available problem -solving plans have prerequisites 
that are not present in the situation. Then the prerequisites of a plan 
become a goal that the problem solver tries to achieve. Construction 
of the prerequisites is itself a well-structured problem. However, 
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solutioxx of this problezxi reqniireo operators (drawing lines) that are 
not in the set of operators available in the problem space of the main 
problem. ^ 

In this analysis, constructions occur as solutions to auxiliary 
problems that arise in solving the main problem. This view puts prob- 
lems requiring constructions into the class of problems req[uiring 
more than one problem space in their solution. Simon (1973) discussed 
general characteristics of problem solving with multiple problem spaces 
and pointed out that solutions require access to information that is used 
to generate new subgoals, new constraints » and new problem- solving 
operators* 

For ill- structured problems of this kind, the theory of well- 
structured problem solving must be extended by providing a mechanism 
for coordinating activity in different problem spaces* In Perdix, co- 
ordination is achieved by use of general schemata that guide pattern- 
recognition and patterns-completion processes of different kinds. A 
new problem space is generated when a pattern required by the planning 
process in one problem space is incomplete. Then problem- solving 
activity is transferred to a problem space that includes operators 
appropriate for the kind of pattern completion that is required. 

The general nature of this mechanism seems a plausible basis for 
productive problem, solving in many situations that involve composition. 



This emphasizes that a problem is well or ill structured only, in 
relation to a specified problem space. In the specification assumed 
here, pr obi exn- solving operators are the propositions of geometry 
that permit inferences about properties and relations, and operators 
that permit drawing lines are in another problem space. Of course, 
an ej^anded problem space could be specified in which both sets of 
operators were available. In that case, problems requiring con- 
structions would be well defined in the usual sense, and the con- 
struction of auxiliary lines would be guided by ordinary subgoals. 
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It seexxis a reasonable conjecture that an important component o£ com- 
position is a process of pattern completion guided by the composer* s 
knowledge of general schemata that represent general forms of mate- 
rial that is included in the work at various levels of structiire. Flower 
and Hayes' (in press) analysis of planjilng processes in writing seems 
consistent with this general idea* 

This idea also provides an intriguing possibility regarding an 
important aspect of creativity. Investigators who have studied creative 
problem solving in artistic composition have emphasized the importance 
of processes that resoilt In the formulation of interesting problems. 
Apparently skill in problem formulation is important in distinguishing 
artists whose work is recognized in the field from those who are com- 
petent, but not influential <Getzels & Csikszentnrdiialyi, 1976), The 
analysis presented here suggests that the ability to formulate problems 
may be based on knowledge in the form of general schemata and pro- 
cedures for recognizing the possibility of creating specific instances 
and combinations of general structures. 

The general conclusion of this analysis is that in an ill-structured 
problem with an insufficient initial problem space ^ problem solving 
takes place in a number of different problem spaces. The contents of 
the initial problem space depend on the problem solver's knowledge 
about the domain, so problems that are ill- structured for some prob- 
lem solvers may be well- structured for more experienced problem 
solvers. An important feature of ill-structured problems is that new 
problem spaces must be generated in the process of problem r "living. 
There are probably many ways in which this occurs, but the mechanism 
that is in the present version of Perdix, involving generation of prob- 
lems based on schemata that are dilso the basis of planning, seems to 
provide an ^Lnreresting example of the process. 

It should be remembered that the issue of ill- structured problems 
involves other factors in addition to insufficient initial problem spaces. 
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Another way in which a problezxi can have weak structure is to have an 
indefinite goal that can be achieved by alternative combinations of com.- 
ponents or features. The idea of an indefinite goal is represented in 
Perdix as a pattern** re cognition systezn that identifies the various com- 
binations of congruent components that are sufficient to prove that 
triangles are congruent (Greeno, 1976). Since it can work both with 
indefinite goals and incomplete initial problem spaces^ Perdix seems 
to provide a moderately successful extension of problem -solving theory 
into the domain of ill- structured problems* Of course , there are im** 
portant aspects of ill- structured problem solving that are not repre- 
sented in Perdix^ such as the development of new problem- solving 
operators, and discovery of new concepts of strategies in the course 
of problem solving* Recent analyses of learning processes in problem 
solving systems (Ansai b Simon, 1979; Neches & Hayes, 1978; Sussman, 
1975) suggest v^at these generative aspects of creative problem solving 
may be understood best as instances of learning. 

General Nature of Set 

The traditional behaviorist explanation of set is that a higher -level 
response that has high strength dominates performance on the problem. 
The explanation in Perdix is consistent with this idea and adds a specific 
mechanism by which higher-level responses ca-n have their dominating 
effect* The e3q>lanation gains in interest because the cognitive structure 
that causes set is the same as the structure that permits constructions* 
It is of some interest to consider the relationship between the mechanism 
proposed here and various phenomena of problem -solving set that have 
been investigated experimentally. 

There are two general kinds of problem*^ solving set. One kind is 
typified by Luchins' water-jug tasks and the examples from geometry 
discussed in this paper, in wliich the problem solver is biased toward 
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the use of a problem -solving; plan or method. A second kind of phe- 
nomenon ia involved in functional fixedness » studied by Duncker (1945), 
in which use of an object or idea in one context prevents the problem 
solver from recognizing a potential use of that object or idea in a 
subsequent problem situation* 

Biased top-down planning . The prinv-iple of schema -based planning 
represented in Perdix gives a straightforward explanation of problem- 
solving set that involves bias toward use of a specific problem -solving 
method. For example, a system like Perdix involving schemata for 
solution types in Luchins* water -jug task would show biases of the same 
kind as it shows in the geometry problems considered in this paper, in 
agreement with performance of hximan subjects (Luchins, 1942). 

Lewis (Note 9) has also developed an analysis of set to use a specific 

problem-solving method. In Lewitu* system, a sequence of actions that 

* 

occurs regularly can become integrated into a single action. This inte- 
gration can eliminate tests for appropriateness of intermediate steps 
in the solution. Without performijag these tests, the problem solver 
may miss opportunities to solve tkxG problem in a more efficient way, 
as in the situation studied by Luchins. Using a letter substitution task, 
luewis obtained evidence that subjects integrated problem -solving steps 
in a way consistent with his model, but they maintained a capability of 
noticing conditions for applying alternaUve operations when they were 
instructed to use them if possible. It seems possible that Lewis* system 
coidd provide an explanation for the development of structures that 
correspond to plans in the version of Perdix described in this paper. 
Plans are integrated action sequences but, in general, use of a plan is 
optional, so that with appropriate instructions a plan' s inappropriate 
use cc ^ald be avoided. 

Fimctional fixedness ♦ Phenomena involving functional fiscedness 
seem to be of a different character from those involving a specific 
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problem- solving zriethod. Weislserg and Snls' (1973) analysis of the 
candle problena andJMagon's (Note 10) analysis of the two^-string prob- 
lem identified analysis of features of objects in the situation as an 
important component of the process of solving the problem* For ex- 
ample, in the candle problem where a box must be seen as a potential 
supporting surface, a condition for solutxoa m^y be the problem- solver 
noticing the flatness of the box. Magone .t'ound that subjects achieved 
a greater variety of solutions in the two^-striag problem if they were 
initially prompted to consider features of objects than if they were 
initially prompted to find a solution of a specified kind« such as exten- 
sion of one of the strings or causing a string to swing back and forth. 

There are two alternative mechanisms that could be postulated in 
the framework of a. production system, for explaining ftmctional fixedness 
viewed as prevention of recognizing some feature of an object in the 
situation. One mechanism would cause functional fixedness by engaging 
in a top-down search for objects with features that could be used in a 
plan-schexxxa that was previously selected. For example, if the system 
bad-selected the plan of extending a string in the two- string problem, 
then the analysis of objects in the situation would involve their length 
rather than other features that would fit into different possible plans 
for solving the problem. A second mechanism would involve competing 
productions for identifying features of objects. Suppose that an object 
has two features that can be identified by different productions, and one 
of these is much stronger than the other because of the way the object 
has already been used in the situation. Then when that object is con- 
sidered by the problem solver, the production that could identify the 
second feature may be prevented from executing by the rapid execution 
of the stronger production. 

The mechanism of top-down search is very similar to the mech- 
anism that is represented in Ferdix to provide am explanation for 
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problem -Bolving set based on top-*down planning* Consider Figure 2, 
and recall that Perdijc solves this problem, by proving that triangles 
are congrtient. The solution involves recognizing the pretrence of tri- 
angles in the diagram, rather than another feature that is also present, 
the fact that the two angles involved in the goal ox the problein have the 
same vertex. Perdix fails to notice a relevant feature of the problem 
'because a general plan-schema that includes tests for different features 
is active and prevents testing for the feature of a shared vertex. A 
siinulation of problem solving in situations like the candle or two- 
string problem would require a somewhat different use of this kind of 
structure, since there are several different objects in the situation, 
and in some cases failure to find a feature of an object needed for the 
current plan apparently leads the problem solver to pass by that object 
rather than to test the object for additional features* However, it 
seems reasonable to conjecture that the basic structure of schema*^ 
based planning that causes Perdix to show problem- solving set in geom- 
etry would also produce functional fixedness in situations where attempts 
to use a general plaji lead to the neglect of important features of objects. 

Phenomena recently reported by Halstead-Nussloch (Note 11) can 
be interpreted by assxixning a top-down search for problem, features. 
Halstead-Nussloch trained different groups of subjects to identify 
serial patterns using two different pattern languages taken from anal- 
yses by Restle (1970) and Simon (1972). Results indicated that subjects 
trained to represent serial patterns in terms of hierarchies of trans- 
formations applied that schema in the analysis of sequences that could 
be analyzed either as hierarchies of transformations or as sequences 
composed of two or more interleaved subsequences. Another kind of 
set phenomenon tlaat can be interpreted as resulting from top-down 
search is the difficulty of simple discrimination learning following a 
few trials of random feedback, reported by Levine (1971). Levine's 
Interpretation was that during random feedback trials subjects rejected 
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simple hypotheses about stimulus attributes and removed them from 
consideration 9 aind thus were prevented from recognizing simple rela- 
tionships between stimulus attributes and feedback on later trials. 
Search for solution was apparently g\iided by a metahypothesis that the 
correct rule was a sequential pattern^ which permits a very large 
number of x>ossibilities. Plans, as represented in Perdix, establish 
categories of hypotheses that guide search for a solution to a problem, 
and thus planning processes provide a specific procedural hypothesis 
with which to imder stand Levine's findings. 

The second mechanism, in which use of an object in one way causes 
a feature of the object to be ignored, probably involves a different fimc- 
tional level of productions from the planning procedures that we have ' 
considered in this paper^ Some cases in which a feature of an object 
is ignored probably involve simple perceptual salience* In the candle 
problem, where use of a box as a candle-stand is Inhibited by its use 
for holding tacks, solution is facilitated if the word "Box'* is printed 
on the box, relative to the situation in which "Tacks" is printed on the 
box (Glucksberg & Weisberg, 1966), This presximably aids recognition 
of the physical features of the box through simple direction of attention. 
A similar phenomenon has recently been reported by Sweller and Gee 
(1978) who found that effects of set in Luchins-type water-jug problems 
and I-ievine-type induction problems were greatly reduced by perceptual 
manipulations* In the water-jug situation, Sweller and Gee virtually 
eliminated the effect of set by having subjects write their solution 
nimierically, rather than in terms of letters designating the jars used. 
In induction problems, the manipulation involved giving feedback that 
described the correct stimulus, rather than stating whether the sub- 
ject's response was correct or wrong. Both of these manipulations 
seem to be interpretable as avoiding the removal of attention from 
aspects of the situation that are important in solving a problem^ and 
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thus support the hypothesis that set occurs because o£ relatively low 
salience of the important stimulus features. 

In other cases, however, suppression of detection of a feature is 
apparently related to a more active process. In Duncker's (1945) 
gimlet problem, use of the gimlet as a hook was inhibited by the sub- 
ject's use of the gimlcc to bore holes for the conventional hooks that 
were available. In a production system, solution of the problem of 
boring holes would strengthen productions for identifying features of 
the g^imlet used in boring holes and co\ild make less likely the recog- 
nition of features involved in serving as a hook. 

All of the explanations of functional fixedness proposed here are 
based on the idea that productions must be executed for the relevant 
features of objects to be recognized. The required productions can 
be prevented by the dominance of other recognition productions, in- 
volving top-down search, ordinary perceptual salience, or recent use 
in another context. 
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Cbde 

National Naval I'.edical Center 
Bethesda. MD 200 14 

1 Library 

Navy Personnel R&D Center 
San Diego. CA 92152 

6 Commanding Officer 

Naval Research Laboratory 
Code 2527 

Washington. DC 20390 

1 JOHN OLSEN 

CHIEF OF NAVAL EDUCATION & 

TRAINING SUPPORT 
PENSACOLA, FL 32509 

1 ; Psychologist 

ONR Branch Office 
*I95 Summer Street 
Boston. MA 02210 

1 Psychologist 

ONR Branch Office 
536 S. Clark Street 
Chicago. IL 60605 

1 Office of Naval Research 
Code 200 

Arlington. VA 22217 

1 Code 436 

Office of Naval Research 
Arlington. VA 22217 

1 Office of Naval Research 
Code 437 

800 N. Ouincy SStreet 
Arlington, VA 22217 

5 Personnel & Training Research Program 
(Code 458) 
Office of Naval Research 
Arlington, VA 22217 



5s 



Ittsbur^h/Greeno August S* 1979 



Page 2 



Navy 



Psychologist 

OFFICE OF NAVAL RESEARCH BRANCH 
223 OLD HARYLEBONE ROAD 
LONDON, NK» ENGLAND 

Psychologist 
ONR Branch Ofrice 
1030 East Green Street 
Pasadena^ CA 91101 

Scientific Director 

Office of Naval Research 

Scientific Liaison Group/Tokyo 

American Embassy 

APO 5^n Francisco « CA 96503 



A* A. SJOHOU^ 

TECH. SUPPORT, CODE 201 

NAVY PERSONNEL R& D CENTER 

SAN DIEGO, CA 92152 

Dr. Alfred F. Smode 

Tiraining Analysis & Evaluation Group 

(TAEG) 
Dept. of the Navy 
Orlando, FL 32813 

CDR Charles J, Theisen, JR. MSC, USN 
Head Human Factors Engineering Div . 
Naval Air Development Center 
Warminster, PA 1897^ 



Office of the Chief of Naval Operations 1 
Research, Development, and Studies Eranc 

(OP-102) 
Washington, DC 20350 

Scientific Advisor to the Chief of 

Naval Personnel (Pers-Or) 
Naval Bureau of Personnel 
Room 1410, Arlington Annex 
Washington, DC 20370 

LT Frank C. Petho, HSC, USNR (Ph.D) 
Code L51 

Naval Aerospace Medical Research. Laborat 
Pensacola. FL 32508 

DR. RICHARD A. POLLAK 
ACADEMIC CaiPUTIHG CENTER 
U.S. NAVAL ACADEMY 
.ANNAPOLIS, HD 21402 

Roger W. Remington, Ph.D 

Code L52 

NAMRL 

Pensacola, FL 3250S 
Dr • l#orth Scanland 

Chief of ?javal Education and Training 
Code N-^ 

NAS« Pensacola, FL 32508 



Gary Thomson 
Naval Ocean Systems Center 
Code 7132 

San Diego, CA 92152 
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Air Force 



HQ USAHEUE & 7 th Array 
0DC50PS 

USAAREUE Director or GED 
APO New York 09^03 

DR^ RALPH OUSEK 

U,S. ASHY RESEARCH INSTITUTE 

5001 JISEHHQWER^AVENUE 

ACEXANDRIA,^ VA 22333 

Dr. Ed Johnson 
Army Research Institute 
5001 Eisenhower Blvd. 
Alexandria, VA 22333 

Dr. Michael ICaplan 
U.S. ARMY RESEARCH INSTITUTE 
5001 EISENHOWER AVENUE 
ALEXANDRIA, VA 22333 

Dr. Milton S. Katz 
Individual Training & Skill 
Evaluation Technical Area 
U.S. Army Research Institute 
5001 Eisenhower Avenue 
Alexandria « VA 22333 



Dr, Genevieve Haddad 

Program Manager 

Life Sciences Directorate 

AFOSR 

Boiling AFB. DC 20332 

Dr. Roger— Penneil 
AFHRL/TT 

Lowry AFB, CO 80230 

Dr. Marty Rockway (AFHRL/TT) 
Lowry AFB 
Colorado 80230 

Jack A. Thorpe, Capt, USAF 

Program Manager 

Life Sciences Directorate 

AFOSR 

Boiling AFB, DC 20332 

Brian K. Waters, LCQL. USAF 
Air University 
Maxwell AFB 
Montgomery, AL 36112 



Dr. Beatrice J. Farr 
Aroy Research Institute (PERI-OK) 
5001 Eisenhower Avenue 
Alexandria. VA 22333 

Dr. Harold F. O^Neil. Jr. 
ATTN: PERI-OK 
5001 EISENHOWER AVENUE 
ALEXANDRIA, VA 22333 

Dr. Robert Sasmor 

U. S. Army Research Institute for the 

Behavioral and Social Sciences 
5001 Eisenhower Avenue 
Alexandria « VA 22333 

Dr. Frederick Steinheiser 
U. S. Army Reserch Institute 
5001 Elsenhower Avenue 
Alexandria » VA 22333 
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H, William Greenup 
Education Advisor (EO31) 
Education Center » MCDEC 
guantico^ VA 2213^ 



••Ir . Richard Lanterman 
PSYCHOLOGICAL RESEARCH (G-P-1/62) 
U.S. COAST GUARD HQ 
'WASHINGTON , DC 20590 



1 Director t Office of Manpower Utilization 
HQ, r-Xarine Corps (MPU) 
BOB. Bldg. 2009 
Quantlco, VA 2213*1 

1 DR. A.L» SLAFKOSKY 

SCIENTIFIC ADVISOR (CODE RD-1 ) 
HQ, U.S. HARINE CORPS 
WASHINGTON, DC 20380 
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Other DoD 



1 Dr, Stephen Andrlole 

ADVANCED RESEARCH PROJECTS AGENCY 
1*»00 WILSON BLVD. 
ARLINGTON, VA 22209 

12 Defense Docunentation Center 
Cameron Station « Bldg. 5 
Alexandria « VA 223^^ 
Attn: TC 

1 Dr. Dexter Fletcher 

ADVANCED RESEARCH PROJECTS AGENCY 
moo WILSON BLVD. 
ARLINGTON « VA 22209 

1 Military Assistant for Training and 

Personnel Technology 
Office of the Under Secretary of De 

for Research & Engineering 
Room 3D129* The Pentagon 
Washington, DC 20301 



Civil Govt 



1 Dr. Susan Chipman 

Basic Skills Program 
National Institute of Education 
1200 19 th Street fJ^ 
Washington « DC 20208 

1 Dr • Joseph I. Lipson 

Division of Science Education 
Room H-638 

National Science Foundation 
V/ashington, DC 20550 

1 Dr. John Mays 

National Institute of Education 
1200 igth Street NW 
Washington, DC 20208 

se 1 Dr. Arthur Kelmed 

National Intltute of Education 
1200 19th Street IIW 
Washington, DC 20208 



1 Dr. Andrew R. Molnar ' 
Science Education Dev . 

and Research 
National Science Foundation 
Washington , DC 20550 

1 Dr. Jeffrey Schiller 

National Institute of Education 
1200 19th St. fJW 
Washington, DC 20208 

1 Dr* Thomas G- Sticht 
Basic Skills Program 
National Institute of Education 
1200 19th Street fM 
Washington « DC 20208 

1 Dr. Frank Wi throw 

U. S. Office of Education 
UOO 5th Street 
Washington. DC 20202 

1 Dr. Joseph L. Young, Director 
Memory & Cognitive Processes 
National Science Foundation 
Washington, DC 20550 
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Hon Govt 



1 Dr. Earl A. Alluisl 
HQ. AFHRL (AFSC) 
Brooka AFB. TX 78235 

1 Dr» John R« Anderson 

Department of Psychology 
Carnegie Hellon Uhiversity 
Pittsburgh. PA 15213 

1 Dr. John Annett 

Department of Psychology 
University of Uarwick 
Coventry CVH 7AL 
ENGLAND 

1 DR. MICHAEL ATWCX)D 

SCIENCE APPLICATIONS INSTITUTE 
no DENVER TECH* CENTER WEST 
7935 E. PRENTICE AVENUE 
ENGLEUOOD, CO 80110 

1 1 psychological research unit 
Dept. of Defense (Army Office) 
Campbell Park Offices 
Canberra ACT 2600, Australia 

1 Dr. Alan Baddeley 

Medical Research Council 

Applied psychology Unit 
15 Chaucer Road 
Cambridge CB2 2EF 
EMGLAND 

1 Dr. Patricia Baggett 

Department of Psychology 
university of Denver 
University Park 
Denver « CO 80208 

1 Mr Avron Ba^rr 

Department of Computer Science 
Stanford University 
Stanford. CA 9^305 

1 Dr« Nicholas A. Bond 
Dept* of Psychology 
Sacramento State College 
600 Jay Street 
Sacramento, CA 95819 



}k>n Govt 



1 Dr. Lyle Bourne 

Department of Psychology 
University of Colorado 
Boulder. CO 80302 

1 Dr. Kennoth Bowles 

Institute for Information Sciences 
University of California at San Diego 
La Jolla, CA 92037 

1 Dr. John S* Brown 

XEROX Palo Alto Research Center 
3333 Coyote Road 
Palo Alto, CA 9**30U 

1 Dr. Bruce Buchanan 

Department of Computer Science 
Stanford University 
Stanford, CA 9^*305 

1 DR. C. VICTOR BUNDERSON 
WICAT INC* 
- UNIVERSITY PLAZA. SUITE 10 
1160 SO. STATE ST. 
OREM, UT 8**057 

1 Dr. John B. Carroll 
Psychometric Lab 
Univ, of No- Carolina 
Davie Hall 013A 
Chapel Hill, NC 2751*4 

1 Charles Myers Library 
Livingstone House 
Livingstone Road 
Stratford 
London E15 2LJ 
ENGLAND 

1 Dr. William Chase 

Department of Psychology 
Carnegie Mellon University 
Pittsburgh. PA 15213 

1 Dr. Michel ine Chi 

Learning R&D Center 
University of Pittsburgh 
3939 O'Hara Street 
Pittsburgh. PA 15213 
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1 Dr. William Clancey 

Department of Computer Science 
Stanford University 
Stanford, CA 911305 

1 Dr. Allan K. Collins 

Bolt Beranek & Nevman, Inc. 
50 Ho ul ton Street 
Cambridge, Ha 02138 

1 Dr. Meredith Crawford 

Department of Engineering Administratio 
George Washington University 
Suite B05 

2101 L Street N. W, 
Washington » DC 20037 

1 Hr« Ken Gross 

Anaeapa Sciences* Inc. 

P.O. Drawer 0 

Santa Barbara, CA 93102 

1 Dr. Hubert Dreyfus 

Department of Philosophy 
University of California 
Berkely, CA 94720 

1 MAJOR I. N« EVONIC 

CANADUK FORCES PERS. APPLIED RESEARCH 
1107 AVENUE ROAD 
TORONTO, ONTARIO^ CANADA 

1 Dr. Ed Feigenbaun 

Department of Computer Science 
Stanford University 
Stanford, CA 94305 

1 Mr. Wallace Feurzeig 

Bolt Beranek & Neman, Inc. 
50 Houlton St. 
Cambridge, MA 02138 

1 Dr. Victor Fields 
Dept. of Psychology 
Montgomery College , 
Rockville, HD 20850 



ton Govt 



1 Dr. Edwin A. Fleishman 

Advanced Research Resources C>"gan* 
Suite 900 

4330 East Vest Highway 
Washington^ DC 20014 

1 Dr. John R. Frederiksen 
Bolt Beranek & Newnan 
50 Houlton Street 
Cambridge, MA 02138 

1 Dr. Alinda Friedman 

Department of Psychology 
University of Alberta 
Edmonton , Alberta 
CANADA T6G 2J9 

1 Dr. R. Edward Geiselman 
Department of Psychology 
University of California 
Los Angeles, CA 9002i| 

1 DR. ROBERT GLASER 
LRDC 

UNIVERSITY OF PITTSBURGH 
3939 O'HARA STREET 
PITTSBUROT, PA 15213 

1 Dr. Ira Goldstein 

XEROX Palo Alto Research Center 
3333 Coyote Road 
Palo Alto, CA 913011 

1 Dr ^ Ron Hambleton 
School of Education 
University of Massechusetts 
Amherst, HA 01002 

1 Dr. Barbara Kayes^Roth 
The Rand Corporation 
1700 Main Street 
Santa Monica, CA 9OUO6 

1 Dr. Frederick Hayes-Roth 
The Rand Corporation 
1700 Main Street 
Santa Fk>nica , CA 90^06 
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Non Govt 



1 Dr. Jaraes R. Hofftoan 

Department of Psychology 
University of Delaware 
Newark. DE 19711 

1 Library 

Hum RRQ/We stern Division 
27857 Berwick Drive 
Carmel. CA 93921 

1 Dr. Earl Hunt 

Dept. or Psychology 
University of V.'ashington 
Seattle » WA 98105 

1 Mr. Gary Irving 

Data Sciences Division 
Technology Services Corporation 
2811 Wilshire Blvd. 
Santa Monica CA 90403 

1 'Dr. Steven W. Keele 
Dept. of Psychology 
University of Oregon 
Eugene, OR 97^03 

1 Dr. Walter Kintsch 

Department of Psychology 
University of Colorado 
Boulder « CO 30302 

1 Dr. David Kieras 

Department of Psychology 
University of Arizona 
Tuscon, A2 85721 

1 Dr. Stephen Kosslyn 
Harvard University 
Department of Psychology 
33 Kir kl and Street 
Cambridge, HA 02138 

1 Mr. Marlin Kroger 
1117 Via Goleta 

Palos Verdes Estates, CA 902711 



Non Govt 



1 LCOL. C.R.J. LAFLEUR 

PERSONNEL APPLIED RESEARCH 
NATIONAL 'DEFENSE HQS 
101 COLONEL BY DRIVE 
OTTAWA, CANADA K1A OK 2 

1 Dr. Jill Larkin 

Department of Psychology 
Carnegie Mellon University 
Pittsburgh, PA 15213 

1 Dr, Alan Lesgold 

Learning R&D Center 
University of Pittsburgh 
Pittsburgh, PA 15260 

1 Dr , Michael Levine 

Department of Educational Psychology 
University of Illinois 
Chanpaifn* XL 61 820 

1 Dr . Rob er t A . Lev i t 

Manager , Behavioral Sciences 
The BEH Corporation 
7915 Jones Branch Drive 
HcClean, VA 22101 

1 Dr • Robert Linn 

College of Education 
University of Illinois 
Urbana , IL 61 801 

1 Dr. Hark Miller 

Systems and Information Sciences Labora 

Central Research Laboratories 

TEXAS INSTRUI4ENTS, INC. 

Mail Station 5 

Post Office Box 5936 

Dallas, TX 75222 

1 Dr. Richard B. Mlllward ^ 

E)ept. of Psychology 
Hunter Lab. 
Brown University 
Providence, RI 82912 
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1 Dr. Allen Hunro 

Univ. of So. California 
Behavioral Technology Labs 
3717 South Hope Street 
Los Angeles, CA 90007 

1 Dr. Donald A Norman 

Dept. of Psychology C-009 
Univ. of California, Son Diego 
La Jolla, CA 92093 

1 Dr. Seymour A. Papert 

Massachusetts Institute of Technology 
Artificial Intelligence Lab 
5^5 Technology Square 
Cambridge p HA 02139 

1 Dr. Janes A. Paulson 

Portland State University 
P.O. Box 751 
Portland » OR 97207 

1 HR, LUIGI PETRULLO 

2131 ti. EDGEtfOOD STREET 
ARLINGTON, VA 22207 

1 DR. PETER POLSON 

DEPT. OF PSYCHOLOCT 
UNIVERSITY OF CCU>RADO 
BOULDER t CO 80302 

1 Dr. Peter B. Read 

Social Science Research Council 
605 Third Avenue 
New York. NT 10016 

1 Dr. Frmd Reif 
SESAME 

c/o Riysics Department 
university of California 
Berkely. CA 9^720 

1 Dr. Andrew M. Rose 

Amerloan Institutes for Research 
1035 Thoiaas Jefferson St. NV 
Washington. DC 20007 
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1 Dr. Ernst 2. Rothkopf 
Bell Laboratories 
600 Mountain Avenue 
Murray Hill, NJ 0797*» 

1 Dr. David Runielhart 

Center fdr Hunan Infomation Processing 
Univ. of California, San Diego 
La Jolla, CA 92093 

1 DR. WALTER SCHNEII^R 
DEPT. OF PSYCHOLOGY 
UNIVERSITY OF ILLINOIS 
CHAMPAIGN^ IL 61820 

1 Dr. Allen Schoenfeld 

Department of Kathematics 
Hamilton College 
Clinton* NY 13323 

1 Dr. Robert Saith 

Department of Computer Science 

Rutgers University 

New Brunswick, NJ 08903 

1 . Richard Snow 

School of Education 
Stanford University 
Stanford, CA 91305 

1 Dr. Robert Sternberg 
Dept. of Psychology 
Yale University 
Box 11A, Yale Station 
New Haven. CT 06520 

1 DR. ALBERT STEVENS 

BOLT BERANEK & NEWMAN. INC. 
50 HOULTON STREET 
CAMBRIDGE^ KA 0213Q 

1 DR. PATRICK SUPPES 

INSTITUTE FOR MATHEMATICAL STUDIES IN 

THE SOCIAL SCIENCES 
STAMFORD UNIVERSITY 
STANFORD, CA 9*^305 
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Non Govt 



1 Dr. Klkumi Tatsuokfi 

Computer Based Education Research 

Laboratory 
252 Engineering Research Laboratory 
University of Illinois 
Urbana, IL 61801 

1 Dr» F-laurice Tatsuoka 

Department of Educational Psychology 
university of Illinois 
Giampaign* IL 61 801 

1 Dr » John Thomas 

IBM Thomas J. Watson Research Center 
P,0. Box 218 

Yorktown Heights » NY 10598 

I^DR- PERRY THORNDYKE 
THE RAND CORPORATION 
1700 MAIN STREET 
SANTA MONICA » CA g0406 

1 Dr» Douglas Towne 

Univ, of So. California 
Behavioral Technology Labs 
3717 South Hope Street 
Los Angeles « CA 90007 

1 Dr. J. lAtlaner 

Per ceptron ic s • Inc • 
6271 Variel Avenue 
Woodland Hills, CA 9136^1 

% Dr* Benton J. Underwood 
Dept* of Psychology 
Northwestern University 
Evanston , CO201 

1 Dr. Phyllis Vfeaver 

Graduate School of Education 
Harvard University 
200 Larsen Hall* Appian Way 
Cambridge, MA 02138 

1 Dr« David J* Weiss 
N660 Elliott Hall 
University of Minnesota 
75 E. River Road 
Minneapolis, MN 55^55 



Non Govt 



1 DR. SUSAN E. WHITELY 
PSYCHOLOGY DEPARTMENT 
UNIVERSITY OF KANSAS 
LAWRENCE, KANSAS 660M4 

1 Dr. J. Arthur Woodward 
Department of Psychology 
University of California 
Los Angeles V CA 9002U 

1 Dr • Karl Zinn 

Center for research on Learning 

and Teaching 
University of Michigan 
Ann Arbor » MI ^a^0^ 
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